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ABSTRACT 

It  is  shown  that  the  model  of  two-  or  multistage  programming  undi^r  risk 
results  from  the  application  of  the  principle  of  dynamic  planning*  in 
special  structured  dynamic  decision  situations  under  risk.   By  u ^ing  this 
property,  some  characteristics  of  the  solution  set  of  dynamic  planning 
problems  will  be  derived. 


*This  principle  is  well  known  and  discussed  as  "flexible  Planung"  in  the 
German  management  literature  in  recent  times. 
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1.   Decision  Situation 

Present  and  future  actions  of  a  firm  are  usually  interdependent.   Ac- 
tions (decisions)  made  in  a  present  period  are  able  to  influence  the  set 
of  feasible  decisions  in  the  following  periods  as  well  as  the  value  of 
the  objective  function  for  the  entire  number  of  planning  periods.   If,  for 
example,  a  firm  wants  to  realize  a  proposed  investment  it  has  to  decide 
how  to  use  it  in  future  periods  to  be  able  to  make  a  decision  at  the  pre- 
sent time  of  planning.   So  the  decision  situation  which  has  to  be  considered 
in  this  paper  is  defined  by  several  planning  periods  and  decision  instants. 
If  the  future  development  of  the  nature  (the  relevant  datas f or  the  decision 
like  cash  flows)  is  certain,  all  future  actions  or  decisions  can  be  deter- 
mined at  the  present  time  of  planning.   However,  if  the  decision  situation 
is  defined  by  risk  (the  development  of  the  nature  in  future  periods  is  a 
random  variable  with  known  distribution  function)  it  is  no  use  to  deter- 
mine uniquely  future  actions  (decisions)  at  the  present  time.   The  set  of 
feasible  decisions  (the  decision  space)  in  future  periods  depends  on  the 
outcome  of  the  random  variable  nature.   Future  decisions,  uniquely  deter- 
mined at  the  present  time  of  planning,  are  neither  necessary  feasible, 
nor  optimal.   Such  dynamic  decision  situations  under  risk  are  defined  by 
(Hax/Laux,  1972,  p.  319). 

Def .  1:   a)  Decisions  have  to  be  made  at  H  >  2  succeeding  points 
of  time. 

b)  The  nature  at  every  point  of  time  h  (h=l,  2,  ...H)  is 
a  random  variable  (at  h:=l  with  only  one  outcoire). 

c)  The  set  of  feasible  decisions  (actions)  -the  decision 
space  -ath  e{2,  3,  ...,h}  depends  on  the  decisions 
which  have  been  made  at  h=l,  2,  ...,  h-1  and  tha 
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outcomes  of  the  random  variable  at  h=l,  2,  ...,n. 

If  the  nature  is  a  discrete  random  variable,  the  decision  situation, 
given  by  Def.  1  can  easily  be  illustrated  by  using  a  state  tree.   For 
H:=2  we  obtain  for  instance  figure  1. 

Figure  1 
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The  nature  at  h:=l  has  a  degenerate  distribution  function.  The  only  outcome 
is  defined  by  the  matrix  M  and  the  vectors  s  ,  b  with  the  probability  one. 
At  h:=2  the  nature  is  a  discrete  random  variable  with  the  Q  outcomes 
M  ^,  b  ^,  A  ^1  and  the  probabilities  P  •  M  ^,  A  "^  mean  matrices  ind 

■'  q 

b   ,  s„  vectors.   For  example  figure  1  can  be  interpreted  as  fellows: 
W'y   =b  means  the  restrictions  induced  by  the  production  technicue  of  a 
firm.   At  h:=l  one  has  to  determine  the  plan,  i.e.  the  level  of  the  decision 


vector  y  .   Until  the  end  of  the  first  period  (at  h:=2),  depending  on  the 
outcome  of  the  random  variable  nature  (especially  the  transformation  matrix 
A   )  and  the  level  of  the  derision  vector  y  ,  lots  of  different  goods  (A  *^y  ) 


will  be  offered  on  a  market.   For  the  outcome  q  the  vector  of  demand  is 
b^''.   As  the  production  plan  (level  of  the  decision  vector  y  )  his  to  be 
determined  at  h:=l,  supply  and  demand  are  not  necessarily  equal  (A  ^y  ^b  ^). 
The  columns  of  matrix  M  ^   define  the  different  kinds  of  activities  to  fill 
the  possible  gap  between  supply  and  demand  for  the  outcome  q  of  the  nature 
at  h:=2.   y  ^  means  the  related  decision  vector. 


2.   The  Principle  of  Dynamic  Planning 

In  the  above  defined  decision  situation  it  is  obviously  no  use  to 
determine  uniquely  the  level  of  the  decision  vector  y   (i.e.  y  '^=y  Vq)  at 
h:=l.   On  the  other  hand  it  is  also  no  use  to  determine  the  level  of  y  at 
h:=l  by  neglecting  future  decisions  as  the  sequence  of  decisions  (the  policy) 
must  be  optimal  for  the  entire  number  of  planning  periods. 

One  approach  to  handling  this  problem  is  to  determine  future  actions 
depending  on  the  information  (development  of  the  nature  and  previous  deci- 
sions) available  at  that  point  of  time  they  have  to  be  done.   At  h:=l  the 
optimal  decision  has  to  be  made  with  regard  to  these  future  eventual  deci- 
sions.  This  approach  is  called  dynamic  planning  and  is  well  kno.vm  and 
discussed  as  "flexible  Planung"  in  the  German  management  literat  ire  in  re- 
cent times.   The  principle  of  dynamic  planning  is  defined  by  (Hax/Laux, 
1972,  pp.  319-20;  Hax,  1970,  pp.  131-33). 

Def.  2:  A  principle  of  planning  is  called  dynamic  (flexibli)  if  at 
the  point  of  time  h  >1 

a)  eventual  decisions  will  be  made  for  every  outccTie  of  the 
random  variable  nature  at  h  =  1,  ...,  H  and 

b)  the  optimal  decision  at  h  will  be  determined  wi rh  regard 
to  the  eventual  decisions  at  h  +  1,  ...,  H. 
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Under  the  assumption  that  the  decision  maker  is  risk  neutral,  by  using  the 
principle  of  dynamic  planning  we  obtain  for  the  above  discussed  example 
the  optimization  problem 

opt      I    Q 


,-  {si/  .  Z_   (P,  s^^  f  ^(y^))) 


^^-  ■       . 


■I   =  {y'  |y'€T^.   3  y'^^O  with  M^^  y2q  =  b^'^  -  A 


2q   2q   ,  2q    ,  2q   1 


and  the  Q  eventual-decision  functions  depending  on  y 

'   o2q.  1,         2q    ^, 
S2q  y   (y  ):  =  S2q  y  ^'i'opt! 

M^q  y2q  ^  ^2q  _  ^2q  ^1 
y2<l>0 

The  optimal  production  plan  at  h:=l  depends  twice  on  the  decisio-i  at  h:  =  2. 
First,  only  such  vectors  y  tT^  are  allowed  to  be  chosen  that  are  associated 
with  feasible  solutions  y  ^  €  T  *^  Vq  at  h:  =  2;  and  second,  the  optimal  plan 
y  has  to  be  determined  in  consideration  of  the  eventual  decision  functions 
at  h:=2.   (We  assume  T^^  0  and  restricted.   For  T=0  there  is  no  feasible 
solution.   The  assumption  T^  restricted  can  easily  be  fulfilled  by  defining 
an  upper  bound  for  the  sum  of  variables  in  y  ) . 

By  using  the  principle  of  dynamic  planning  the  optimal  decisions  (ac- 
tions) at  h:=2  are  determined  equivalent  to  Bellman's  principle  jf  optimal- 
ity  in  dynamic  programming  (Bellman/Dreyfus,  1971). 

Def.  3:   An  optimal  policy  has  the  characteristic  that,  independent 
of  the  origin  state  of  system  and  the  first  decision,  the 
remaining  decisions  have  to  be  an  optimal  policy  for  the 
state  that  results  from  the  first  decision. 


3.   Characteri.stics  of  Dynamic  Planning  Problems 
If  M^'^  =  M^  Vq  at  h  =  1,  2,  .  .  .  ,  H,  we  obtain  for  our  example 

which  defines  a  typical  two-stage  progranuning  problem  under  risk  with  dis- 
crete distribution  function  (Werner,  1<)7  3,  p.  50).   But  the  model  of  two- 
stage  programming  under  risk  is  not  restricted  to  discrete  random  variables. 
It  is  also  applicable  to  continuous  random  variables  and  was  discussed  by 
Dantzig  (1955,  pp.  204-5)  for  H  >2. 

While  Def.  2  defines  a  general  principle  of  planning  for  decision 
situations  given  by  Def.  1,  the  model  of  H-stage  programming  under  risk  was 
developed  only  for  stochastic  linear  programming  problems  in  the  above  de- 
fined situation.   Of  course  it  was  also  applied  to  problems  with  nonlinear 
objective  functions  in  recent  times  (Sachan,  1970,  pp.  211-232),  but  the 
assumptions  of  linear  restrictions  and  deterministic  matrices  for  the  de- 
cision vectors  Vh  (only  the  right-hand-sides  and/or  the  transformation  ma- 
trices are  allowed  to  be  stochastic)  are  still  necessary  conditions  for 
its  application.   So  we  are  able  to  establish  the  following  characteristics 
for  dynamic  planning  problems  analogous  to  the  H-stage  programming  model 
if  the  decision  matrices  are  deterministic  at  the  H  points  of  time. 

Under  the  assumption  that  the  set  of  feasible  decisions  (the  decision 
space)  is  not  empty  for  any  outcome  of  the  random  variable  at  H  and  every 
feasible  decision  at  H-1  (i.e.  in  the  example  T  =  T^  by  using  Bellman's 
principle  of  optimality  Dantzig  (Dantzig,  1966,  pp.  578-9)  has  shown. 

Lemma  1:   An  H-stage  convex  optimization  problem  can  be  transformed 
to  an  equivalent  (H-l)-stage  optimization  problem  by 
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neglecting  the  restrictions  of  stage  H. 

If,  for  instance,  m''  =  M  =[E|-Ejin  the  above  discussed  example 

f  2^    ^q  1 ^ 
(E  means  an  identity  matrix) ,  there  is  for  every  vector  [b   -  A"  y  J  a 

solution  y  *^.   The  functions  s'  y  ^{y")  can  be  determined  by  using  the 
theory  of  linear  programming.   Then  the  restrictions  at  h:=2  can  be  ne- 
glected (Werner,  1973,  pp.  113-128).   It  is  T~  =  T^.   By  applying  lemma  1 
the  number  of  restrictions  are  considerably  reduced. 

To  be  able  to  reduce  an  H-stage  to  a  (H-1) -stage  optimization  problem, 
it  is  necessary  that  the  set  of  feasible  decisions  is  not  empty  for  any 

outcome  of  the  random  variable  at  the  point  of  time  H  and  every  feasible 

G, 
decision  at  H-1.   If  k,£R   defines  the  consequences  of  the  outcome  of  the 

random  variable  at  h  and  the  decision  at  h-1  that  has  to  be  compensated 

by  the  decision  vector  y  and  M  the  (G,  x  L,  )  decision  matrix  then  Kail 

(Kail,  1966,  pp.  246-272)  has  shown 

,  h  h    A  ^  ^h 

Lemma  2:   There  is  a  y  >0  with  yry     =  Ic  for  every  k^R   if 

G,  <  L,  ,  the  first  G,  columns  are-  if  necessary  afier  permu- 
h   h  h 

tation- linear  independent  and  there  is  a  nonnegacive 

'h 
be  represented  as  a  negative  linear  combination  of  the 


If  the  matrices  M  suffices  the  criteria  of  lemma  2  Vh,  the  sets  of 
feasible  decisions  are  not  empty  at  any  point  of  time  h.   The  H-stage 
optimization  problem  can  be  reduced  to  an  equivalent  one-stage  problem 
in  accordance  with  lemma  1.   I^ether  a  matrix  ^'  with  rank  G  ari  G,  <L, 
suffices  the  above  mentioned  criteria  can  be  examined  by 

a)  Form  M^:  =  [m"^^  |  M^^J  with  M^^  nonsingular  square  and  the 
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S^CLj,-  n,^)  matrix  M^'^ 

b)  Optimize 

^h  Lh   „Gh  Gh 
My   =  M   y 

y   i  0 

_  Gh 
e  r  >   r.  y 

r-»  min! 

with  the  variable  r,  the  G.^-co3ponent  c;l-.:nr.  vector  e  =  '1,1,..., 1) 


If  M^  doesn't  suffice  the  criteria  of  lema  I  ve  have  to  derive  addi- 
tional restrictions  for  the  decision  variables  at  h-1  to  avoid  t -.e  deoisio: 
spaces  at  h  becoming  empty  for  any  outcome  of  the  randr-  variable  nature 
and  any  feasible  previous  decision. 

For  K:=2  to  handle  this  problem,  first  approaches  were  developed  for 
special  structures  of  M^  by  using  the  Moore-Per.ro se  (generalized;  inverse 
(see  appendix,  example  1).   These  approaches  are  applicable  to  H  >  1  also. 
If  the  random  varia:)le  nature  is  a  discrete  one  at  every  point  c:  time,  it 
is  much  simpler  to  derive  the  necessary  additicnal  restrictions.   Espe- 
cially for  H:=2  rather  simple  algorithims  can  be  derived  by  dualizing  the 
optimization  problem  (see  appendix,  example  2)  and  using  the  Danizig 'Volte 
decomposition  principle  (Dantzig/Madansky,  196",  pp.  Ir5-17r^.   -JLl  these 
approaches  are  only  applicable  to  special  structured  matrices  >f*  and/or 
discrete  random  variables.   Also  lemma  1  was  only  proved  while  ecuivalent 
reduced  optimization  problems  were  derived  solely  for  some  simple  struc- 
tured -Droblems. 
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Appendix 
EXAMPLE  1; 
Given 

M  y  =  f  ;  f :=  vector  of  constants 

y  >  0 
with  the  Moore-Penrose  (Generalized)-Inverse  M  of  the  matrix  M,  the  set 
of  feasible  solutions  can  be  represented  by 

(yj  =  M*f  +  [e  -  M*  m]  w  >  0;  w  I  0. 

If  the  random  variable  nature  has  a  continuous  density  function,  we  obtain 

for  our  example  the  optimization  problem 
opt  " 


'i^^i  (^1^^  +_/  g(P  •  S2y^(y^)  d^} 


g(^)  means  the  density  functions  of  the  random  variable  ? :=  b  -  A  y  . 
The  set  Tj  of  feasible  solutions  y  is  defined  by 

T^  =  T^n  (m^  y^  =  b^  -  A^  y-*-;  y^  >  0  } 

By  using  the  Moore-Penrose-Inverse  we  obtain 

{y2]  =  m2*  [b^  -  a2  y'j  +[e-m2*m2J„>0   ^ 
M^*  [b^  -  A^  y-*"]  +  [e  -  M^*  M^J  w  >  0   , 

the  additional  restrictions  for  y   to  reduce  T   to  T~.  If  for  example 

2*  2 

M   is  the  left  inverse  of  M  they  will  be  reduced  to 

^2*  ,  2  >  ^2*  ,2  1 
M   b  i  M   Ay 

T~  is  defined  by 

T-  =  jy'  I  m'  y^  =  bl;  m2*  a2  yl  i  m2*  b^;  y^  t  o]  . 

EXAMPLE  2: 

For  our  example  with  a  discrete  random  variable  nature  the  optinization 

problem  can  be  written  as 
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K  y^  ^h  '  ^21  y^^  +  •••  +  Pq  •  S2Q  y^"^  -♦^p'^' 

21 


A^^  y'  +  M^^  y^l 

=  b" 

A^^'y^  t      

'.  •   -^  M^"  y^" 

.V« 

y\          y'\ 

y^« 

>    0 

The  dual  of  this  linear  program  has  a  blockangular  structure  and  can  easily 
be  solved  by  using  modifications  of  the  Dantzig/Wolfe  decomposition  principle. 
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